ConMLP: MLP-Based Self-Supervised Contrastive Learning for Skeleton Data Analysis and Action Recognition.

Human action recognition has drawn significant attention because of its importance in computer vision-based applications. Action recognition based on skeleton sequences has rapidly advanced in the last decade. Conventional deep learning-based approaches are based on extracting skeleton sequences through convolutional operations. Most of these architectures are implemented by learning spatial and temporal features through multiple streams. These studies have enlightened the action recognition endeavor from various algorithmic angles. However, three common issues are observed: (1) The models are usually complicated; therefore, they have a correspondingly higher computational complexity. (2) For supervised learning models, the reliance on labels during training is always a drawback. (3) Implementing large models is not beneficial to real-time applications. To address the above issues, in this paper, we propose a multi-layer perceptron (MLP)-based self-supervised learning framework with a contrastive learning loss function (ConMLP). ConMLP does not require a massive computational setup; it can effectively reduce the consumption of computational resources. Compared with supervised learning frameworks, ConMLP is friendly to the huge amount of unlabeled training data. In addition, it has low requirements for system configuration and is more conducive to being embedded in real-world applications. Extensive experiments show that ConMLP achieves the top one inference result of 96.9% on the NTU RGB+D dataset. This accuracy is higher than the state-of-the-art self-supervised learning method. Meanwhile, ConMLP is also evaluated in a supervised learning manner, which has achieved comparable performance to the state of the art of recognition accuracy.

A deep learning-based recognition for dangerous objects imaged in X-ray security inspection device.

Several limitations in algorithms and datasets in the field of X-ray security inspection result in the low accuracy of X-ray image inspection. In the literature, there have been rare studies proposed and datasets prepared for the topic of dangerous objects segmentation. In this work, we contribute a purely manual segmentation for labeling the existing X-ray security inspection dataset namely, SIXRay, with the pixel-level semantic information of dangerous objects. We also propose a composition method for X-ray security inspection images to effectively augment the positive samples. This composition method can quickly obtain the positive sample images using affine transformation and HSV features of X-ray images. Furthermore, to improve the recognition accuracy, especially for adjacent and overlapping dangerous objects, we propose to combine the target detection algorithm (i.e., the softer-non maximum suppression, Softer-NMS) with Mask RCNN, which is named as the Softer-Mask RCNN. Compared with the original model (i.e., Mask RCNN), the Softer-Mask RCNN improves by 3.4% in accuracy (mAP), and 6.2% with adding synthetic data. The study result indicates that our proposed method in this work can effectively improve the recognition performance of dangerous objects depicting in the X-ray security inspection images.

Non-convex optimization based optimal bone correction for various beam-hardening artifacts in CT imaging.

Tube of X-ray computed tomography (CT) system emitting a polychromatic spectrum of photons leads to beam hardening artifacts such as cupping and streaks, while the metal implants in the imaged object results in metal artifacts in the reconstructed images. The simultaneous emergence of various beam-hardening artifacts degrades the diagnostic accuracy of CT images in clinics. Thus, it should be deeply investigated for suppressing such artifacts. In this study, data consistency condition is exploited to construct an objective function. Non-convex optimization algorithm is employed to solve the optimal scaling factors. Finally, an optimal bone correction is acquired to simultaneously correct for cupping, streaks and metal artifacts. Experimental result acquired by a realistic computer simulation demonstrates that the proposed method can adaptively determine the optimal scaling factors, and then correct for various beam-hardening artifacts in the reconstructed CT images. Especially, as compared to the nonlinear least squares before variable substitution, the running time of the new CT image reconstruction algorithm decreases 82.36% and residual error reduces 55.95%. As compared to the nonlinear least squares after variable substitution, the running time of the new algorithm decreases 67.54% with the same residual error.

Object tracking based on incremental Bi-2DPCA learning with sparse structure.

In this paper, we propose a novel object tracking method that can work well in challenging scenarios such as appearance changes, motion blurs, and especially partial occlusions and noise. Our method applies bilateral two-dimensional principal component analysis (Bi-2DPCA) for efficient object modeling and real-time computation requirement. An incremental Bi-2DPCA learning algorithm is proposed for characterizing the appearance changes of newly tracked objects. Also, to account for noise and occlusions, a sparse structure is introduced into our Bi-2DPCA object representation model. With this sparse structure, the appearance of an object can be represented by a linear combination of basis images and an additional noise image. The noise image, which indicates the location of noise and occlusions, can be used to effectively eliminate the influence caused by noise and occlusions and lead to a robust tracker. Instead of the reconstruction error commonly used in eigen-based tracking methods, a more accurate method is adopted for the computation of observation likelihood. The method is based on the energy distribution of coefficient matrix projected by Bi-2DPCA. Experimental results on challenging image sequences demonstrate the effectiveness of the proposed tracking method.